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A technique for reducing the number of iterations necessary 
for solving linear programs using the primal-dual algorithm is 
presented. It appears that the new method will also decrease the 
number of iterations over any other simplex algorithm. A FORTRAN 
program incorporating the technique, as well as some comparative 


SS 
computational results are given. 


DEIN 7) tions 


MOK Lt OB 
TABLE OF CONTENTS 

SECTION PAGE 

1.) UNMROSUGDIGN GIMME, 0. 6k ss ee a ee OT 

II. THE STANDARD PRIMAL-DUAL ALGORITHM. ........ °° «8 

III. DESCRIPTION OF THE NEW TECHNIQUE. ......... «211 

EV. CONBUTATIONAL RECUUISN 2 44. .... . Smee 6 4 2) 13 

V. DESCRIPTION OF THE COMPUTER PROGRAM ........ 15 

RDB ET OCRARHVANE I) en... 5), TS 


APPEND IX e e e e e e e e e e e e e oe e e e e e e e e e e e l 9 














TABLE 


i Dare 


LIST OF TABLES 


TABLE OF COMPARATIVE RESULTS .. 


PAGE 


13 





SECTION I 
INTRODUCTION 


The primal-dual algorithm, as developed by Ford and Fulkerson, 
theoretically permitted faster convergence in solving linear programs 
over such methods as the two-phase or Charnes' M-method. Instead of 
first driving the artificial variables to zero to obtain a feasible 
solution and then working to optimality in a second phase, the primal- 
dual works towards optimality and feasibility in the primal and dual 
problems at the same time. This is accomplished during what would 
be the first phase for the other procedures. However, in actual 
computational experience, the primal-dual algorithm has not achieved 
faster convergence over the other simplex procedures. 

This paper presents” a modification of the primal-dual algorithm 
that does accomplish faster convergence than the usual primal-dual 


algorithm and perhaps also the other simplex methods. 


1 
Professor Harold Greenberg provided the idea for the new 
technique. 


SECTION II 
THE STANDARD PRIMAL-DUAL ALGORITHM 


Using matrix notation, the linear programming problem is: 
Minimize z = Z + GX 
Given AX =H 
x, 2 0 j ae) ere 5) 
J 
where Zo is a constant and 
C is a 1 x n vector with components * 20, 32 1,....9 


H is anm x 1 vector with components h. = 0, i. @ 1,.4.008 


A is anm x n matrix with elements a. j i @/,...m 
> > 


| =, . see 
X is an n x 1 vector with components iG ee 

o e 2 e 
The standard primal-dual, as it appears in Dantzig, consists 


in augmenting the constraint equations with artificial variables as, 


AX + Y=H (1) 


oa 0 1 Pe Pee 
i 
where Y is an m x 1 vector with components consisting of the arti- 


ficial variables Y43 and forming 


w=w + DX 
O 





where 
m 
Woe us h, 
i=l 
and D is a 1 x n vector with components ae JOE Lawes, 0, wrewe 





2 
George B. Dantzig, Linear Programming and Extensions 
(Princeton: Princeton University Press, 1963), pp. 247-53. 


It is noted that both the a and the h, must be positive 
prior to starting the computations. Negative h, may be made 
positive by multiplying the associated constraint equations by 
a minus one. The method for correcting negative * is discussed 
in the "Description of the Computer Program" section of this 
paper. 

The problem is to find a 20, w = 0, that minimizes z 
subject to (1). At any stage of the iterative procedure the 


equations have the form: 


X + AJX =H, 
Y + AX = igs (2) 
DX =w- Ww 
O 
cx = Zz -2Z 
O 


where x, is a vector representing the current basic variables 

and X is a vector representing the current non-basic variables. 
The numerical subscripts 1 and 2 represent partitioned matrices 
and vectors. Matrices and vectors with bars are the corresponding 
original matrices and vectors after the usual pivot operations 
within the primal and dual problems. When an artificial variable 
becomes non-baSic, it is dropped from further consideration. 

This results in the A, matrix and the H, vector. Each iteration 
in the standard primal-dual algorithm consists of the following: 


a) Finding the most negative d, value for those indices 


j fell, = 0. 


b) If there are no indices with this property, the 


multiplier k = min [e./ - 4.) is used to obtain at 


Cae 
least one ¢, equal to zero by 


c. =c, + k(d.) 
j j id, 


c) The index r = j is obtained for the minimum 4, with 
c, = 0. Then x is selected to be basic. 

d) Then min Ca.) is found for air > 0. This will 
select a pivot row in either the x, or Y sets of 
equations, 

e) The simplex pivot method is then used. If the pivot 
row is in the Y set of equations the artificial variable 
in that row is dropped. Thus, in any case, one of the 
forms in (2) is achieved. 

When wo = 0, the basic solution is optimal and the problem 

is solved. 

The actual computations should include rules to prevent 

cycling, such as the perturbation technique or the use of 


lexicographic ordering. 
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SECTION III 


DESCRIPTION OF THE NEW TECHNIQUE 


The primal-dual algorithm is modified in a two-step procedure. 
In the first step, a pivot row in the Y set of equations is selected. 
By only considering elimination of artificial variables, after m 
or less iterations, w equals zero. At this point the equations 


have the form: 


— 


+ 
Xx, AX 


Z + CX = 
O 


i 
=| 


N | 


where all c, are positive. If all the h, are positive, the solution 
is optimal. We then stop. However, in most cases, this stage of 
the problem will contain one or more negative h,. In this case 
the subscript "it" is assigned to the row with the most negative 
h. The following procedure is then used as the second step of the 
modification: 

a) The equation containing h,, is multiplied through by minus 

one. This produces h, , > 0. 
b) The "it' equation is then added to all equations with 


"it" equation 


negative h,. All basic variables except the 
now become feasible. 

GC) Je Loiiimrti ne tiescanonical form an artificial variable is 
added to the "it'’ equation. A new infeasibility equation 
with w. Sunes is formed from the "it" equation. 


The process now reverts to the primal-dual algorithm to achieve 


w equal to zero. Since the canonical form has been maintained and 


ll 


all c, have been kept positive throughout the process, once 


Ww equals zero, the solution is optimal. 
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SECTION IV 


COMPUTATIONAL RESULTS 


Several problems were run on an IBM 360/67 using both the 
standard primal-dual and the primal-dual with the new technique. 
The problems used were test problems from the SHARE Linear 
Programming Project and two highly degenerate assignment type 
problems. Results are given in Table I with the two assignment 


problems listed first. 


TABLE I 


TABLE OF COMPARATIVE RESULTS 





PRIMAL-DUAL WITH STANDARD 
SIZE SIMPLEX THE NEW TECHNIQUE PRIMAL-DUAL 

PROBLEM (m x n) ITERATIONS Iterations Seconds Iterations Seconds 
Assignment 74 x 150 89 yi 83 29 
Assignment 34 x 376 74 ez o7 28 
SHARE 1A 33 x 64 70 ag 7 So 7 
SHARE 1D 27 x 45 61 38 38 

SHARE ILE Silex 106 66 96 30 136 42 
SHARE 1F 66 x 135 184 125 86 [ys 114 
SHARE 2A 30 x 103 114 7 25 ike, 43 


In the two assignment problems the primal-dual with the new technique 


resulted in optima different from that of the standard primal-dual since 


3) 
Philip Wolfe and Leola Cutler, "Experiments in Linear Programming," 


Recent Advances in Mathematical Programming (New York: McGraw-Hill 
Book Co., Inc., 1963), p. 198. 
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these problems have non-unique solutions. The two methods resulted 
in the same optima in all other problems. 

No accurate timing data is available. The timing data in the 
above table though does give an indication of the reduction in 
execution times possible with the new technique. However, the 
modified method does perform less work than the usual method 
because in the first step ratios and comparisons are only taken 
for the artificial rows. The restart of the problem in the second 
step requires only an insignificant amount of time. Thus, in the 
table, the number of iterations represents a measure of improvement 
of the new method. The new technique shows significant reductions 
in the number of iterations from the two-phase standard simplex 
method in four out of the five problems where a comparison is 
possible. When comparing the new technique with the standard 
primal-dual, a similar reduction is evident in the larger problems. 
It therefore appears that the new method presents a significant 


improvement when the number of variables is large. 
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SECTION V 
DESCRIPTION OF THE COMPUTER PROGRAM 


The accompanying program (see Appendix) is written in the 
FORTRAN IV language, and was used to run all test problems with 
the exception of the two assignment type problems (since these 
only deal with zeros or ones in the A matrix, considerable 
reduction in the core memory requirement could be made with a 
slight modification of the program). The program will handle up 
to 69 constraint equations and up to 149 variables, and requires 
about 160,000 bits of core storage. Columns may be designated 
by alphanumeric names, but rows must be consecutive integer 
values not to exceed the value 69. Only the non-zero elements 
of A, C, and H need be read in. ALI h, must be positive, but 
negative oe are allowed. 

Names used in this program conform to those already outlined 
in this paper. _— not previously discussed are defined as: 

FF is a calf apsloatioge constant used to insure that all Zits 

are integer. 

EP is a constant used in the round-off error control. 
DI is the cumulative multiplication of the pivot elements. 
CE is a vector identical to the initial C, and is used to 

calculate z. 

AX is the pivot column in the Revised Simplex tableau. 
CNAME is a vector of column names. 


DUAL is the vector of dual variables. 
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DB is a vector of simplex multipliers used to calculate the ey: 


R is a vector used to record whether each variable is basic 


orartliirer. 


E is a computed scalar used in the updating and round-off 


eontio). 


P is a vector of multipliers used in the actual pivot operation. 


ITR indicates the number of iterations performed. 


INDEX controls the use of the new technique (INDEX equals zero 


yields the standard primal-dual, and INDEX equals one 


incorporates the new technique). 


IB is a vector of variable designators (a negative number 


indicates an artificial variable, and a positive number 


indicates a basic variable). 


All other names are defined in the program. 


Once the data has been read in, the oe are tested for negative 


values, 


Tei ili | oe are positive, the primal-dual commences. However, 


if there is one or more negative Bi the following procedure is fol- 


lowed: 


a) 


b) 


c) 


d) 


RMIN is set equal to the minimum c.. 

nis set equal ton + 1 and m is set equal tom + 1. 

The coefficients of all variables in the added constraint 
equation indicated in b) above are set equal to FF including 
x (Variable x does not appear in any other constraint 
equation.) 


Then CL is set equal to minus RMIN. 
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e) The right hand side value, he is entered as: 


ha = k(FF) 


where k is a number larger than the sum of the Au 

in the optimal tableau. 
The problem is now modified so it may be handled by use of the 
primal-dual algorithm. 

The remainder of the program is a FORTRAN representation of 
the steps outlined in the sections "The Standard Primal-Dual 
Algorithm" and "Description of the New Technique.''’ However, for 
computer calculations, an essential addition to the procedures is 
some control over round-off error. 

Round-off error develops when two large numbers, say y and z, 
(differing only slightly from each other), are subtracted from 
each other such as: 

X=y-2z 
In this program the absolute value of x divided by y is compared 
to EP. If it is less than EP, x is set equal to zero. Asa 
further control, the values of DB, B, and H are updated each 


iteration. 


iy 
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